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Abstract 

In  this  paper,  we  combine  the  theoretical  result  of  Pontryagin*s  Minimum 
Principle  and  a  new  numerical  method  to  obtain  a  fast  algorithm  for  the  tra¬ 
jectory  design  problem  for  a  reusable  launch  vehicle.  We  work  with  the  outer- 
loop  equations  for  an  aircraft  and  consider  the  angle-of-attack  to  be  the  input. 
We  cast  the  trajectory  design  problem  as  an  optimal  control  problem  and  use 
Pontryagin's  Minimum  Principle  to  obtain  first  order  necessary  conditions. 
These  are  in  the  form  of  a  two-point  boundary-value  problem  ^PBVP)  and 
we  solve  them  by  means  of  the  Modified  Simple  Shooting  Method  (MSSM). 
In  recent  work,  tire  MSSM  has  been  shown  to  be  superior,  both  in  speed  and 
accuracy,  for  TTB  VPs, 
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TPBVP  Two  point  boundary  value  problem 
MSSM  Modified  Simple  Shooting  method 

X  State  variables 

A  Costate  variables 

V  Velocity  of  the  air  vehicle  with  respect 

to  an  earth  fixed  frame 
7  Flight  path  angle 

X  Downrange 

H  Altitude 

L  Lift 

D  Drag 

Cp  Drag  coefficient 

Cl  Lift  coefficient 

m  Mass  of  vehicle 

g  ^  Acceleration  due  to  gravity 

T  Time  unit  (90  s) 

a  Angle  of  attack,  the  control  parameter 

K\^  K2  Parameters  in  cost  function 

e,  El  Tolerances  in  the  MSSM  algorithm 

H  Hamiltonian  function 

0-7803-8155-ti/04/$17.00  2004  IEEE 


1.  Introduction 

Recently  several  authors  have  studied  the  problem  of  tra¬ 
jectory  redesign  for  hypersonic  aircraft  [7],  [6].  The  usual 
procedure  for  solving  such  problems  is  to  set  it  up  as  a 
constrained  optimal  control  problem.  Lu  and  Schierman 
used  direct  methods  to  numerically  solve  the  optimal  con¬ 
trol  problems.  Alternatively,  one  could  use  Pohtryagin’s 
Minimum  Principle  to  obtain  first-”Order  necessary  condi¬ 
tions  for  the  optimal  control  problem  and  obtain  a  two- 
point  boundary-value  problem  (TPBVP). 

Originally  created  to  solve  two-point  boundary  value 
problems  (TPBVPs),  the  Modified  Simple  Shooting 
Method  (MSSM)  has  been  shown  to  be  superior,  both  in 
speed  and  accuracy,  to  known  methods  for  solving  TP¬ 
BVPs  [2].  Since  optimal  control  problems  can  be  for¬ 
mulated  with  differential  equations  and  boundary  condi¬ 
tions,  it  seems  feasible  to  propose  that  the  MSSM  could 
be  used  to  solve  problems  in  optimal  control.  Here,  the 
original  MSSM  algorithm  (given  with  detail  in  [2])  was 
altered  and  used  in  conjimction  with  Pontryagin’s  Mini¬ 
mum  Principle  in  an  attempt  to  solve  an  optimal  control 
problem  in  trajectory  generation. 

In  this  paper,  we  consider  the  problem  of  trajectory  re¬ 
design  of  the  unpowered  reentry  phase  for  a  h5rpersonic  ^ 
air  vehicle.  We  consider  outer  loop  equations  governing 
the  motion  of  the  center  of  mass  and  consider  the  angle  of 
attack  to  be  the  input  variable.  The  lift  and  drag  forces 
for  the  aircraft  considered  were  obtained  from  a  polyno¬ 
mial  neural  network  approximation  of  experimental  data. 
Effector  deflections  were  chosen  so  that  the  aircraft  un¬ 
derwent  trimmed  flight. 

2.  Modified  Simple  Shooting 

The  Modified  Simple  Shooting  Method  has  been  used  to 
successfully  solve  TPBVPs  [2].  Using  Pontrya^n’s  min¬ 
imum  principle  [5],  we  can  obtain  first-order  necessary 
conditions  for  an  optimal  control  problem  and  apply  an 
adapted  version  of  the  MSSM  to  solve  the  resulting  TP¬ 
BVP. 
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Suppose  we  want  to  minimize  the  cost  function 


subject  to 

x  =  f{x,u),  (2) 

x{to)  =  xo,  x{tf)  =  Xf  fixed,  (3) 

ti(-)  €  m-  (4) 

The  following  equation  can  be  formed  from  (1)  and  (2), 

kt)  =  -fLm-ix,  (5) 

where  A  are  called  the  costates.  The  pre-Hamiltonian  is 
defined  by 

W(x,u,  A)  =  y{t)f{x,u)  +l{x^u).  (6) 

Let  x*{t)^u*{t)  be  the  optimal  solution.  Then  Pontrya- 
gin’s  Minimum  Principle  provides  the  Hamiltonian  [4], [5]: 

H{x*{t)yit),X(t))=  inf  Hix*it),v,\{t))  (7) 

v€n(t) 

for  all  t  S  [to y  if].  The  above  equation  can  also  be  stated 
as: 

u*  (f )  =  argmin  H  (x ,  v,  A) .  (8) 

Equations  (2), (3), (5),  and  (7)  constitute  a  TPBVP.  To 
solve  the  problem,  one  needs  to  compute  the  value  of 
A(fo)‘  Once  this  is  done,  the  functions  u(f),  are 
known  for  all  f  €  [to,  f/]-  We  propose  to  use  the  MSSM 
[2]  to  solve  this  TPBVP. 

Two  assumptions  are  needed  for  convergence  of  the  algo¬ 
rithm  [2]. 

Assumption  2.1:  There  exists  an  unique  solution  to  the  opti¬ 
mal  control  problem  (2-5). 

Assumption  2.2:  Let  A  (to)  be  the  initial  condition  of  the 
costates  that  results  in  the  solution  (x(f),  X{t)  to  (2-5).  For 
every  initial  condition  A(to)  within  a  small  neighborhood  of 
A*(to)  there  is  a  unique  solution  defined  on  [to,  The  solu¬ 
tion  is  continuously  differentiable  with  respect  to  changes  in 
the  initial  conditions  of  the  costates. 

The  algorithm  proceeds  as  follows:  Given  a  distance  met¬ 
ric  on 

•  Choose  A(0)  and  reference  path  ^(t)  such  that  0(to)  = 
2^0,  0(t/)  =  Xfy  and  0(t)  is  sufficiently  close  to  the  op¬ 
timal  solution.  Pick  sufficiently  small  numbers  ei  and  e 
such  that  ei>  e. 

•  At  time-step  k: 

-  Compute  u{k)  using  x{k)yX{k)  and  (8). 

-  Integrate  (2),  (6),  and  compute  x{k  + 1),  A(A:  -f  1). 


-  If  d{<j>{k  -h  l),x(A:  +  1))  >  Ely  then  apply  the  modi¬ 
fied  Newton’s  method  and  correct  A(0)  so  that  d{(j){k  -h 
1),  x{k  -h  1))  <  e.  Let  fc  =  A;  + 1. 

-  Else  (we  have  reached  the  final  time),  apply  the 
modified  Newton’s  method  and  correct  A(0)  so  that 

d(xfyx{tf))  <  E. 

-  Stop. 

Notice  in  this  adapted  version  of  the  algorithm,  initial 
values  are  guessed  and  corrected  for  the  cbstates  A.  If  ei 
is  too  small,  the  numerical  method  might  have  difficulties 
in  convergence.  Rom  calculus  of  variations  it  is  known 
that  changes  in  the  costates  will  affect  the  outcome  of  the 
states.  Optimization  of  the  control  variable  is  performed 
at  each  step  of  the  algorithm. 

3.  Reentry  Vehicle  Example 

.j 

The  following  equations  are  sometimes  used  to  model  a 
reentry  vehicle  during  approach  and  landing.  Here,  only 
the  equations  of  longitudinal  motion  are  considered,  de¬ 
scribing  the  motion  of  the  center  of  mass  of  the  vehicle 
subject  to  external  forces.  This  set  of  equations  applies 
primarily  to  the  performance  of  the  vehicle,  while  the  sets 
of  moment  and  elastic  equations  are  less  influential  [1). 

For  t  €  [to,  t/],  the  equations  of  motion  are  given  as 


(9) 

(10) 

X  =  ycos7 

(11) 

H  =  ysm7, 

(12) 

where  V  is  the  velocity,  7  is  the  flight  path  angle,  X  is 

the  downrange  position,  and  H  is  the  altitude, 
drag  are  given  by 

Lift  and 

L  =  qSCi{a) 

(13) 

D  =  qSCoia) 

(14) 

q  =  \p{H)V\ 

(15) 

with  the  value  p{H)  as  the  standard  atmospheric  den¬ 
sity  dependent  upon  the  altitude  H.  The  values  Co  aiid 
Cl  are  the  coefficients  for  drag  and  lift,  respectively  and 
dependent  upon  the  angle-of-attack,  a  (see  Section  4  for 
details). 

Constraints  on  the  control  variable  and  states  at  any 
given  time  t  are 


0“  <  a  <  15° 

(16) 

iy(t)>2177ft 

(17) 

y(t)  >  290  fl/sec 

(18) 
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The  cost  function,  used  to  minimize  the  pitching  moment 
Mo  of  the  wing  body,  is 

J=  f  [Ki  {a  -  aacs?  +  Ki^]  dt  (19) 
Jo 

where  ades  =  5°,  the  angle  at  which  the  minimum  wing- 
body  static  pitching  moment  occurs  for  the  vehicle. 

For  this  example,  the  initial  conditions  given  for  t  =  0 
seconds  are 


V(0) 

=  466  ft/sec 

(20) 

7(0) 

=  -29° 

(21) 

J>f(0) 

=  -15754  ft 

(22) 

m 

=  10066  ft. 

(23) 

The  final  condition  is  H{tf)  =  2274  ft,  with  constraints 
on  the  final  values  for  F,  X  and  H  as  follows. 

y(t/)>342 
Oft<X(t/)  <6000ft 

> -39  ft/sec  (24) 

Using  the  constraint  on  i/,  one  may  obtain  a  final  con¬ 
straint  y{tf)  >  —6.5°. 

4.  Numerical  Results' 

Before  applying  the  algorithm,  the  equations  of  motion 
(9-12)  were  scaled  so  that  the  solutions  were  of  the  same 
magnitude.  Scaling  constants  were  g  =  32.2  fl/s  and 
T  =  90  s.  Accelerations  were  scaled  by  g,  velocities  were 
scaled  by  ^T,  and  positions  were  scaled  by  gT^, 

Each  of  the  sources  for  lift  and  drag  coefficients  were  ob¬ 
tained  from  a  polynomial  neural  network  (PNN)  model 
of  aerodynamics  data  containing  the  information  for  lift 
and  drag  on  a  solid  body  with  aerodynamic  forces  acting 
on  it.  A  polynomial  fit  to  this  PNN  was  used  as  the  first 
source  of  lift  and  drag.  The  second  source  was  created 
using  the  PNN  in  conjunction  with  an  aircraft  model  to 
develop  a  table  of  aerodynamics  data  on  an  aircraft  un¬ 
dergoing  trimmed  flight. 

Normal  Flight  Condition 

For  the  first  attempt  at  solving  this  optimal  control  prob¬ 
lem,  the  lift  and  drag  coefficients  were  approximated  with 
pol)aiomials  of  the  angle  of  attack  a  [3], 

Cd  =  0.0008a® -0.0015a +  0.1269  (25) 

Cl  =  0.0737a  -  0.0460  (26) 

The  set  of  polynomials  was  the  simplest  form  of  the  lift 
and  drag  coefficients  to  implement.  Thus,  it  was  used 
first  to  obtain  an  initial  solution  and  to  compare  with 
future  results. 


Optimization  was  accomplished  using  a  necessary  con¬ 
dition  for  the  minimum  of  the  Hamiltonian:  if  a  is  the 
optimal  control  for  (2),  then  A,t)  =  0.  Ha  was 

calculated  and  set  equal  to  zero  to  get  a  formula  for  ob- 
tmning  the  optimal  control  a.  This  routine  is  justified 
in  that,  for  this  cost  function  (1),  Haa  >  0,  thus  the 
extremal  a  is  in  fact  a  minimum. 

The  algorithm  obtained  a  solution  in  2.18  seconds  with 
four  iterations  of  the  loop  (see  Figure  1).  Corrections 
to  A(0)  occurred  until  the  solution  at  time  k  fell  within 
Bi  =  0.15  of  the  reference  trajectory.  Integration  was 
halted  when  the  solution  at  the  final  time  was  within 
e  =  0.01  of  xi.  For  this  case,  the  control  profile  stays 
within  the  given  constraints  for  a  (16)  (see  Figure  2). 

Normal  Flight  Condition  with  Trimmed  Flight 

Using  the  MSSM  with  the  tables  reflecting  lift  and  drag 
coefficients  from  trimmed  flight,  results  were  obtained  for 
a  normal  flight  situation. 

TOMLAB’s  ucsolve  function  was  used  for  the  solution  of 
(7).  Convergence  of  the  MSSM  occurred  after  331  sec¬ 
onds.  The  intermediate  tolerance  Bi  was  set  at  0.1,  with 
the  final  tolerance  b  at  0.25.  The  control  profile  remains 
within  bounds  (see  Figure  4). 

A  Failure  Case  with  trimmedflight 

Since  the  adapted  version  of  the  MSSM  seemed  to  work 
sufficiently  well  in  solving  a  “normal”  flight  case,  it  was 
used  to  attempt  a  solution  for  the  case  where  one  con¬ 
trol  surface  had  failed  to  respond  to  commands.  That  is, 
one  of  the  four  control  surfaces  on  the  aircraft’s  body  has 
failed  and  is  locked  in  position.  Failures  of  the  aircraft 
control  surfaces  can  cause  merges  in  drag,  decreases  in 
lift,  and  overall  instability  of  the  aircraft.  The  pilot  or  pi¬ 
loting  program  then  becomes  incapable  of  deflecting  the 
failed  control  surface  to  maintain  stable  flight. 

For  this  particular  situation,  the  aircraft’s  left  flap  has 
failed  at  30°  down.  This  was  modeled  by  the  lift  and  drag 
coefficients,  which  were  obtained  from  a  table  of  aerody¬ 
namics  data  formed  from  the  PNN  with  an  aircraft  model 
whose  left  flap  was  deflected  at  30°  down.  The  same  im¬ 
plementation  for  the  MSSM  was  used  as  in  Section  4, 
The  final  time  was  changed  to  t/  *=  81  seconds  for  feasi¬ 
bility.  The  tolerances  were  relaxed  also,  with  e  =  1  and 
€i  =  0.2.  The  algorithm  took  2576  seconds  to  converge, 
and  constraints  were  violated  for  V  and  H  (24)  (see  Fig¬ 
ure  5).  However,  the  control  profile  stays  within  the  given 
constraints  (Figure  6). 

5.  Conclusions 

The  MSSM  was  shown  to  be  successful  in  solving  the  sen¬ 
sitive  optimal  control  problem  of  trajectory  design.  The 
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Figure  1.  States  resulting  from  MSSM  using  polynomials  for  drag  and  lift  coefficients 


unfailed  case  resulted  in  a  reasonable  solution  and  con¬ 
trol  profile.  It  may  be  that  the  failed  case  is  an  infeasible 
problem  to  solve  without  allowing  for  some  increased  an¬ 
gular  accelerations.  More  investigation  is  needed  before  ‘ 
substantial  conclusions  can  be  made  on  the  failure  situa¬ 
tion. 

Current  research  involves  reformulating  the  problem  to  a 
time-invariant  set  of  equations  using  the  monotonically 
increasing  function  X{t),  Future  work  includes  attempt¬ 
ing  other  cost  functions  in  place  of  (1).  Other  failmes  are 
to  be  explored  using  this  algorithm.  Continued  research 
on  this  and  better  implementations  of  the  algorithm  will 
provide  improved  solutions  for  the  trajectory  design  op¬ 
timal  control  problem. 
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Control  profile  from  MSSM  using  polynomials  for  drag  and  lift  coefficients 
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Figure  3.  States  resulting  from  MSSM  using  tables  for  trimmed  flight 
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Figure  4.  Control  profile  fi'om  MSSM  using  tables  for  trimmed  flight 
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